Orthogonal Polynomials of Types A and B 
and Related Calogero Models 



Charles F. Dunkl 



Abstract 

There are examples of Calogero-Sutherland models associated to the Weyl groups of 
type A and B. When exchange terms are added to the Hamiltonians the systems have non- 
symmetric eigenfunctions, which can be expressed as products of the ground state with 
members of a family of orthogonal polynomials. These polynomials can be defined and 
studied by using the differential-difference operators introduced by the author in Trans. 
Amer. Math. Soc. 1989 (311), 167-183. After a description of known results, particularly 
from the works of Baker and Forrester, and Sahi; there is a study of polynomials which 
are invariant or alternating for parabolic subgroups of the symmetric group. The detailed 
analysis depends on using two bases of polynomials, one of which transforms monomially 
under group actions and the other one is orthogonal. There are formulas for norms and 
point-evaluations which are simplifications of those of Sahi. For any parabolic subgroup of 
the symmetric group there is a skew operator on polynomials which leads to evaluation at 
(1, 1, . . . , 1) of the quotient of the unique skew polynomial in a given irreducible subspace 
by the minimum alternating polynomial, analogously to a Weyl character formula. The 
last section concerns orthogonal polynomials for the type B Weyl group with an emphasis 
on the Hermite-type polynomials. These can be expressed by using the generalized bi- 
nomial coefficients. A complete basis of eigenfunctions of Yamamoto's Bn spin Calogero 
model is obtained by multiplying these polynomials by the ground state. 



1 Introduction 

A Calogero-Sutherland model is an exactly solvable quantum many-body system in one dimen- 
sion. There are examples associated to the Weyl groups of type A and B, and by the addition 
of exchange (reflection) terms the Hamiltonians have non-symmetric eigenfunctions. In the two 
situations described here, the eigenfunctions are polynomials times the ground state. 

The first example consists of N particles on a circle, with particle j being at angle 9j, 
< 9j < 2tt, parameter k > 0; the Hamiltonian is 

where (ij) denotes the transposition ("exchange") 9{ < — > 9j. 
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Under the transformation x s = exp(6 s y/—l), 

N , a \ 2 

< L2 > H -E«) + 2 * E (^(®)-*). 

i=l v l/ l<i<j<N v * 31 

The orthogonal polynomials associated to Tii are called the non-symmetric Jack polynomials; 
see Baker and Forrester p3Fl|| , Lapointe and Vinet |[LV2| . In Section 2 this Hamiltonian will 



be further described. 

The second example to be studied is the -B-type spin Calogero model of Yamamoto 
||Y'1|| 1; parameters k,k\. 



M «> = -E (£) + iE*? + E 



, v <9xJ 4^~ l ' f-f x 2 
j=i x 7 i=i i=i ' 



+ 2A; V \ , K ~ U \ 2 + k ~ Tl] 

< * T ■ T ■ l Z 



i<i<j<N ^ X i' X i' ■ 

where a,, a^-, are the reflections in the hyperoctahedral group Wjy, defined by xcr, = (xi, . . .,— Xj 

, . . . , Xjv), xcrjj = (. . . , Xj, . . . , Xi, . . .), XTy = (..., — Xj, — ij, .. .). The coefficient | in is 
a coupling constant; it can be changed by rescaling x; this choice is to use the weight function 
exp(— |x| 2 /2), as will be seen later. In Section 5 is the description of a complete orthogonal 
system of eigenf unctions of H2, consisting of polynomials times the ground state 

N 

] [ \x\ - x)\ k n |x*| fcl exp(-|x| 2 /4). 

l<i<j<N i=l 

The technical foundation of this paper is the algebra of differential-difference ("Dunkl") 



operators associated to a reflection group |D1 |. In Section 2, there is an outline of known 
results for the type A case, namely the symmetric group Sjv acting on M. N by permutation of 
coordinates. This section includes a discussion of inner products and self-adjoint operators, and 
orthogonal decompositions. 

Section 3 is concerned with polynomials and operators invariant under parabolic subgroups 
of Sty; these are subgroups which leave intervals {1, 2, 3, . . . , £1}, {£±+1, . . . , ^+£2}, ■ ■ ■ invariant. 
Formulas for the norms of invariant polynomials are obtained. 

In Section 4, the alternating or skew polynomials and operators are examined. There is 
the construction of an important operator associated to any interval {£ + 1, £ + 2, . . . , £ + m} 
which is skew for the associated symmetric group, and which commutes with the appropriately 
transformed version of the Hamiltonian Tii. Any polynomial which is skew-symmetric for a 
parabolic (Young) subgroup of Sjv is divisible by an appropriate minimal alternating polynomial 
(a product of discriminants). The skew operator is used to evaluate the ratio at x = (1, 1, . . . , 1), 
a generalization of the Weyl dimension formula. 
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Section 5 addresses the type B situation and shows how the type A polynomials can be used 
to build type B Hermite polynomials, the eigenfunctions of the transformed 7i 2 - This results in 
a complete set of eigenfunctions with arbitrary parity, that is for any subset A C {1, 2, ... , N} 
there are eigenfunctions which are odd in Xi, i G A and even in Xi, % ^ A. Previously, only the 
cases of all even or all odd parity were studied, the so-called generalized Laguerre polynomials. 

Notations Used Throughout 

m Z + — {0, 1, 2, 3, . . .}, A/jv = Z+ , the set of compositions; 

• A/jy is the set of partitions with no more than N nonzero parts; Af£ = {A G A/jv : Ai > 
A 2 > A 3 --- > A,v > 0}; 

• for a G A/jv, a + denotes the sorting of a to a partition; the permutation of a lying in A/j^; 

• for a, (5 G A/jv, the dominance order is defined by a >z (3 if and only if Yll=i a i — Yli=i A 
for 1 < j < N; and a y (3 means a >z (3 and a ^ (3; 

• for w G SV, the symmetric group, and x G R^, let G R^ be defined by (xw)i = 
x w (i), 1 < i < N, and sgn(w) denotes the sign of w; 

• for a function / on M, N , let (wf)(x) = f(xw), x G R^; 

• for a G A/jv, let x a := Y\iLi x Ti then w{x a ) = x wa , where (wa)i = a w -i^, 1 < i < N, 
w G S N ; 

• an interval \t + 1, £ + m] := {j G Z : £ + 1 < j < £ + m}; 

• for an interval /, let Si = {w G Sn '■ i I implies w(i) = i} (that is, Si is isomorphic to 
the symmetric group of J); 

• for an interval J, let 07 be the longest element in Si, that is, (Ji(i) = 2£ + m + 1 — i, i G 

/= [£ + l,£ + m]; 

• for an interval /, the associated alternating polynomial is ai(x) = Yli x i ~ x j '■ i < 

j and i,j G /}; 

• for a G A/jv, \a\ := «i, a\ ■= fliiKO; 

• for a set A, j^A is the cardinality; 

• for A G A/j£, and i G R, the hook length product is h(\, t) := ]jf =l l$ =1 (\i-j+t+k(#{s 
s > i and j < \ s < Xi}); 

• for a G A/jv, 1 < « < A 7 ", /^(a) = A^ — k(#{s : a s > c^} + #{s : s < i and a s = 
ai}) + ai + 1 (a frequently used eigenvalue associated to a); 
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• for an interval I, a £ A/jv satisfies condition (>, J) respectively (>, I) if i,j G / and i < j 
implies ctj > c^-, respectively > <x,-; 

• for two linear operators A, B the commutator is [A, B] := AB — BA; 

• for t G R, m G Z + , the shifted factorial is (t) m = YliLi(t + * — -Qj f° r ^ ^ -^/v ( an d 
implicit parameter fc) the generalized shifted factorial is (t)\ := Y\iLi(t ~ ~ 

• l JV = (l,l,...,l)eR Jv . 



2 Background 

We review facts about the non-symmetric Jack polynomials expressed in two different bases, 
the relation to the operators introduced by Cherednik, and the inductive calculation of norm 
formulas by use of adjacent transpositions. 

The symmetric group Sn acts on R^ by permutation of coordinates and thus extends to an 
action on functions 

w f(x) := f(xw), xeR N , we S N . 
For a parameter k > 0, the type A Dunkl operators are defined by 

(2.i) ^ = ^. + ^-^-(1-^)), l ^^ N - 

3+1- J 

For each partition A G A/jy (henceforth partitions will be assumed to have no more than N 
parts), there is a space E\ of polynomials, invariant and irreducible under the algebra generated 
by {TiXi : 1 < % < N} and {w : w G Sn}- This algebra can be considered as a subalgebra 
of the degenerate double affine Hecke algebra of type A (the latter acts on Laurent series and 
also contains the multiplications by x~ l , 1 < i < N, Cherednik [C], Kakei [K3]). 

There is a simple relationship between the rational and trigonometric differential- difference 
operators of type A; indeed, let Xi = e Vi , 1 < i < n; and suppose / is a linear combination of 
{e yi ,e~ Vi : I < i < N}, then 

{T iXl ) f = (i + (n - i)k) f +^L + kj2 (/ - m)- 

However, there is no corresponding relationship for type B (the weight function for rational 
type B on the iV-torus only involves one parameter). 
For a G A/jv, 

TiXiX a = (Nk - k#{j : aij > a { } + a { + l)x a 

aj—cti—2 

-* E E 



a s+l -8-1 
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OLi~ Otj 

a.j<cii s=l 

every x 13 in the sums satisfies f3 + -< a + except the cases s = oti — otj > which produce k(ij)x a . 
When j > i and ctj > otj, (ij)ot -< a. 

Thus the operator Ui := TjXj — &X^<i(u) satisfies the triangularity property 

UiX a = K, t (a)x a + J2{A(f3, a)x? : = |a|, /3 + -< a + or a+ = (3 + and a >- /?}. 
The type-A Cherednik operator £j (as in [BF3]) is defined by 

\ k* / tlT" ■ T ■ T* • x # y . t» . 

\ / i i<« ^ j>i J 

and satisfies = (|) (C/j — (fc(iV — 1) + 1)). The set {Ui : i = 1, . . . , N} is commutative 
(more details below), thus there is a basis (for polynomials) of simultaneous eigenfunctions, 
called non-symmetric Jack polynomials. The notation E a (x; 1/k) is used for the normalization 
having one as leading coefficient (of x a ); that is, 

E a (x; 1/k) =x a + ^2{A'(P, ot)x? : \(3\ = \a\, [3 + -< a + or (3 + = a + and (3 -< a} 

(and the coefficients A'(/3,a) depend on k and N). 

In the present paper, we use the dual basis {p a : a G Mn} dfined by the generating function 

n r n ~\ 

(2.2) F k (x, y) := J> Q (x)y Q = J[ I (1 - x^ 1 J](f - x t y 3 )- k I 

a i=l L J=l J 

(x, y G R-^). For A G A/jv, is defined to be the scalar multiple of E\(x; 1/k) such that 

the triangularity property of B(/3, A) was shown in [D3], further B([3, A) is independent of N in 
the sense that B((3, A) remains constant when (3 and A are changed to (f3i, . . . , /3n, 0, 0, . . . , 0), 
(Ai, . . . , \ N , 0, . . . , 0) G Mm respectively (and M > N). Note that the triangularity for {p a } is 
in the opposite direction to that of {x a }. Next we define the linear space E\ as the span of the 
Sjv-orbit of u>\, with basis {u a : a + = A} where u w \ := wu\ for w G Sn (this is well defined, 
since w\ = A implies u>cja = wa for w £ Sjy). 

The intertwining operator of type A is the unique linear map V on polynomials which 

satisfies: VI = 1, V : P n — > P n for each n = 0, 1,2, ... , and V (jj^rpj (x) = Ti(Vp)(x) for 

1 < % < N, x G M. N , each polynomial p (see [D3]). Let £ be the linear map on polynomials 
defined by £ : p a i— > x a /o;!, ct G A/jv and extended by linearity; then each E\ is an eigenmanifold 
for V£ and V^q. = ((JV/c + l) Q +) -1 u; a , each a. 
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We will use (/, g) to denote inner products (of polynomials /, g) which satisfy two conditions: 
TiXi is self-adjoint for each i, and the inner product is S^-invariant; that is, (T i Xif(x),g(x)) = 
(f(x),TiXig(x)) and (wf,g) = {f,w' l g), w G Sn- The irreducibility properties of E\ imply 
that such inner products are uniquely determined up to a constant on each E\. 

Definition 2.1 For polynomials f (x) = ^2 a f a x a , g(x) = J2 a 9aX a , define the A-inner product 



(f,g)A ■= ^f a gpT 

a,f3 



x=0 



and the p-inner product 

a,f3 

where the matrix H is defined by 



Alternatively, (x a ,Pj3(x)) p = 5 a p. 



Homogeneous polynomials of different degrees are orthogonal in both inner products. The 
A-product was introduced in ]D2] and shown to be positive-definite. 



Proposition 2.2 The operators T^Xi are self-adjoint in the p- and A-inner products. 

Proof. The adjoint of multiplication by X{ in the A-product is clearly Tj. For the p-product, 
self-adjointness is equivalent to 

T l {x) x l F k (x,y) = T t {y) y t F k (x,y) 
(the superscripts refer to the variables being acted on); but 



rp(x) „ f , „( {k + VjXiVi ^ 1-Xj 

T> >XiF k {x, y) = F k {x, y)<l + — + k > 

I j£ (1- ^%)(1 



Vj 

% j Hi i 



which is symmetric under the interchange of x and y. □ 

Proposition 2.3 For polynomials f , g andw G Sn, (f,g)p = (wf,wg) p and{f,g)A = (wf,wg)A- 
In particular, the transpositions (ij) are self-adjoint. 

Proof. The first part follows from the equation F k (xw,yw) = F k (x,y). The second part 
depends on the transformation properties of T i; namely w^TiW = T w -i^, 1 < i < N, w G Sn- 
□ 

Corollary 2.4 For partitions A, [l with X ^ E\ J_ E» in both p- and A-products. 
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Proof. The method of ( [|D3|1 , Theorem 4.3) used only the self-adjointness of each TjXj. □ 



Sahi |Sa|1 proved this orthogonality for the p-product. In [D3] we used the modification 
%pi = TiXi + k, where pip a = p(ai, . . . , a« + 1, . . .) "raising" operator; see also ||D4j| . 



Proposition 2.5 For \etf£,f,ge E x , (f,g) A = (Nk + l) x (f,g) p . 

Proof. Since g G E x , J2{P*T a 9 ■ « e Mv, |"| = |A|} = (Nk + l) x g (formula for (Vf) -1 )- 
That is, T a g is (Nk + l) x times the coefficient of p a in the expansion of g in the basis {pp}- 
Let / = E a /a^ a , 9 = i, p 90Pp, then 



J2f*T a g = Y,f*9a(Nk + l) 

a a 

(Nk + l) x (f,g) p . 



□ 



Corollary 2.6 Let / G E x , then f(T)*l = (Nk + l) x f where f(T)* denotes the p- adjoint of 
the operator. 

Proof. For any /i G J\f£, g G E^, 

( 9 J(T)*l} p = (f(T)g,l) p =(f,g) A 

= 6, x (Nk+l) x (f,g) p . 

Since g and \x are arbitrary, f(T)*l = (Nk + □ 

In |D3[ ] we showed that 

TiPiUa = (Nk - k#{s : a s > «;} + a< + l)a> Q 

+ ^J{(*i)^a : a j > f° r a ^ A/jVj 1 < « < AT. 

Also the commutator [T^, Tjpj] = k(TiPi — TjPj)(ij), for i ^ j ( ||D3|1 , Lemma 2.5(iii)). 

This leads to the pairwise commuting operators Ui := TiPi — kJ2j<i(ij)- (These were used 



by Lapointe and Vinet [ |[LV1|| , |[LV2|| 1, see also Cherednik |C[.) 
Definition 2.7 For a G AGv, 1 < i < Af, let 

Ki(a) := ATA; — k(#{s : a s > a^} + #{s : s < i and a s = ctj}) + on + 1. 
These will appear as eigenvalues of Ui, because 

UiUJ a = Ki(a)uj a + kTi{(ij)uj a : i < j and a, < aj} 
— kT,{(ij)u a : j < 1 and <x,- < 



For each partition A, the matrix of U{ with respect to the basis {u a : a + = A} for E\ is 
triangular in the dominance ordering (also for the lexicographic order, a total one). Note if 
a G A/jv, and a« < a,, i < j for some then (ij)a y a. 

The operators Ui satisfy some commutation properties with adjacent transposition: 

(i) [Ui,(j,j + 1)] = 0, if i<j or j + Ki; 

(ii) (i,z + l)C/j(z,z + l) = C/"i+i + A;(i,z + l). 

Theorem 2.8 ( ^4] ; Section 3) For each partition A t/iere exists a unique basis {( a : a + = A} 
/or satisfying 

(1) UiCa = Ki(a)( a , 1 < i < N; 

(2) ( a = uj a + £{B((3, a)oj p : (3 + = \ and (3 y a} . 

(3) (C«,C/J> = 0i/a^/3. 

Corollary 2.9 (\ = uj\, and if o>i = a i+ i, then + l)( a = ( a . 

Proof. The partition A is the maximum element in {a : a + = A}. 

Suppose «j = a i+ i, and expand + l)( a in the basis {(p : [3 + = A = Because 
(z,z + l)( a is an eigenvector for each Uj with |z — j\ > 1 with eigenvalue Ki(a), it must be a 
scalar multiple of ( a . The fact that (i,i + l)^ a = w a and (2.3) (ii) shows the factor is 1. □ 

Proposition 2.10 Suppose a G Ajv > #&era s£>an{£ a , C^,} zs invariant under 

a — 1), and the matrix of a in this basis is 

' c 1 - c 2 
1 -c 

Proof. Let g = cr£ a — c( a , then C/j-g = Kj(a)g for j < « or % + 1 < j; this shows g G 
span{£ Q , Co-a}- The coefficient of uj aa in g is 1, since a y aa. The commutation relation 
oXJiO = Ui+x + ko shows Uig = Ki + i(a)g and Ui + \g = Ki(a)g, but K i+ i(aa) = Ki(a) and 
Ki + x(a) = Ki(aa), thus g = Q aa . Finally, ag = ( a — cctCq — (1 — c 2 )Cq ~~ 1=1 

These equations were found by Sahi f5a] , see also Baker and Forrester ||BF3|| . 
In the basis {E a (x; l/k), E aa (x; l/k)} the matrix of o is ]• By use of the known 

evaluations at x = 1 N and the notation of Definitions 3.10 and 3.17, 

E a (x; l/k) = -TtV^T w / \ Ca(»)- 

a(a+, k + (a)£_ (a) 



where c 



k 



(a) - K i+1 \ 



a 
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Corollary 2.11 Suppose a G Mn and oti > oij+i, then 

U(1 N ) = (1-C)UI N ): 

and 

||C Q || 2 = (i-c 2 )||C«|| 2 , 

forc= Ki(a) _ k K%+i[a) anda=(i,i + l). 

Proof. Since ( aa = cr( a — c( a , we have that 

U(l N ) = aUl N )-cUl N ) 
= (l-c)Ul N ). 

Since a is self-adjoint the matrix of a in the orthonormal basis {Ca/||Ca||> Cra/||Cra||} must be 
symmetric, hence ||Cm|| 2 = (1 - c 2 )||Ca|| 2 - D 

Corollary 2.12 In the same notation, let 

(2.4) f = ( a + (j-^j and A = Ca - 

then af = f and a fx = -f ± . 

In the next section we derive expressions for the norms ||Ca||p> IIC«|Ia as a by-product. If 
ol G Mn and «j > a i+i , then «j(a) — /c i+ i(o!) > «j — ctj+i + k, thus < c < 1 (when k > 0); in 
fact, 

Ki(a) — Kj + i(o!) = ctj — a i+ i + /c(l + #{s : s > i and a s = 

+ #{s : s < i and a s = a i+ i} + #{s : a i+ i < a s < 
The relation of the operator Ui to the Hamiltonian Hi in (1.2) is as follows: let 

N 

Kx)= n ix i -x J -i*nw fc(jv " i)/2 

\<i<j<N z=l 

(an ^Ar-invariant positively homogeneous function), then 
ft(i)(t/, - 1 - fe(JV + l)/2)(/(i)/ft(i)) 

and Xli=i ^| = The eigenvalue of 7ii on the space h{x)E\ is 

TV AT TV 

^(Ki(A) - 1 - ife(7V + l)/2) 2 = ^ A 2 + k J2( N - ^ + + k 2 N(N 2 - 1)/12 

i=l i=l i=l 

9 



(see Baker and Forrester |[BF1 , ||BF2|| , Lapointe and Vinet [|LV2|| ); the last term is the energy 
of the ground state. In the coordinates Xj = exp( 



-19,), 



/ i = 2 fc J]|sin((^-^)/2)| fe . 



i<j 



3 Subgroup Invariants 

A parabolic subgroup of Sn is by definition generated by a subset of + 1) : 1 <i < N}. 
This section concerns subspaces of E\ invariant under a parabolic subgroup. We start with the 
basic structure, an interval and its group of permutations. A typical interval is denoted by / or 
[£i,£ 2 ] and is defined to be {n G Z : t\ < n < £ 2 }. The associated permutation group, denoted 
by Si, is defined as {w G Sn '■ w(i) = i for all % I}. Thus Sj = S m where m = #1. The 
parabolic subgroups of Sn are direct products of such groups corresponding to a collection of 
disjoint intervals in [l,iV]. 

The technique developed in this section will be used to derive formulas for the norms of the 
non-symmetric Jack polynomials ( a , as well as for polynomials with prescribed symmetric or 
skew-symmetric properties for parabolic subgroups. 

For any (3 G A/jv, the set {w/3 : w G Si} has a unique ^-maximal element, which satisfies 
the following: 

Definition 3.1 For an interval I, say that a composition a satisfies property (>,/) or (>,/) 
if an > (Xj, respectively a, > aij, whenever i,j G / and i < j. 

We deal with the case of one interval first. Let I = [£+l,£+m] with l<£+l<£ + m<N. 
The object is to analyze spanj^Q, : w G Si} and sp&n{w( a : w G Si} for a fixed a satisfying 
(>,/). The structure of spanj^Q,} mimics that of E\ (with m variables) with an analogue of 
Tipi. Part of the motivation for the following definition is to have commutativity among the 
operators associated with disjoint intervals. 

Definition 3.2 For a fixed interval I = [£ + 1, £ + m], for i G /, let 

Ti := Tipi -k^2(ij). 

Note that U{ = Ti — kJ2e<j<i(^j)^ an d w^t^w = Ti for w G Si. 

Now fix a composition a satisfying (>,/) and let X = spa.n{( wa : w G Si}, a linear 
space with dim X = #(S , /a), a subspace of E a +. Then X is invariant under Si because Si is 
generated by {(i, i + 1) : £ + l<i<£ + m} and Proposition 2.9 applies. 



Definition 3.3 For w G Si let g wa := w( a . 
(w^wi)^ = ( a ; since the subgroup {w G Si : 
(from the condition {>,!)), Corollary 2.10. 



This is well-defined because w%a = u^a implies 
wa = a} is generated by adjacent transpositions 
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Note that it is not generally true that w(3 = (3 for some composition (3 and w G Sn implies 
w(p = C/3, for example (1,3) £(1,2,1) ^ C(i,2,i)- 

Proposition 3.4 X = span{gp : (3 G Sia}. 

Proof. Consider the set A = {7 : ( y G span-fg^}}, by Proposition 2.10, if 7 G A and 
7; 7^ 7j + i for £ + 1 < % < £ + to, then (i, i + 1)7 G A. Also a G A, hence A = Sja;. □ 

Proposition 3.5 For f3 G Sja, and i & I, 

ngp = K'i((3)gp + k ^{{ij)gp ■ j e I and fa > fa}, 

where 

K '.(fa) = Nk — k(#{s : fa > Pi} + #{s : s < £ and [3 S = fa} + A + 1. 
Proof. First for /3 = a, 

= iUi + k ^2 (u) ) 

= (/Cj(a) + &#{s : £ < s < i and a s = aj})<? a 
(3.1) + fcy^{fa')ff a : £ <j <i and etj > 

because g a = ( a . This is the required formula for this case; the situation {j : i < j < 
£ + m and <x,- > a{} does not occur. 

For an arbitrary w G Sj, let s = w~ l {i), ft = wa, then 

ngp = Tiwg a = wr s g a 

= (Nk - £;(#{j : a t > a s } + #{j : j < I, Uj = a s } + a s + l)wg a 

+ k^2{w(s,j)g a : I < j < £ + to, aij > a s }, 

but w(s,j) = (w(s),w(j))w = (i,w(j))w, fa = a w -^ t ) for any t, fa = a s . Thus 

ngp = Ki(P)9i3 + k ^2i(h w U))gp : j e 1 and a j > A}, 

and otj — fi w (j). □ 

This showed that the structure of the operators {r, : i G /} on X is essentially the same as 
that of {T iPi : 1 < i < N} on E x . 
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Proposition 3.6 Suppose C is a linear operator on X and [C, Tj] = for each i E I , then 
C = cl, a multiple of the identity. 

Proof. The same proof as ( |p3| , Proposition 3.2) for E\ works, replacing {up : (3 + = A} by 
{gp: (3ES ia }. □ 

Proposition 3.7 The operator Ui := Yliei ^ commutes with each w E Si; also [Ui, Ti] = for 
i E I and Uig = Yliei K i( a )9 f or eac ^ 9 e X . 

Proof. To show [Ui, w] = for w E Sj it suffices to prove this for w — (i, i + 1), £ + 1 < i < 
£ + m. Also wllj = UjW if j < i or j > i + 1, thus consider 

wUiU i+1 w = {U i+1 w + k)U i+1 w 

= U i+ i(UiW — k)w + kU i+ iW 
= U i+1 Ui 

= u t u l+1 

(by (2.3)). Since r m = U i+1 we have [Ui,r i+1 ) = 0. 

For any w E Si, Tg + i = w~ l T w (£ + yw , and this shows [Ui, Tj] = for each j E I. 

For any basis element g wa of X, Uig wa = wUig a = w Yliei K i( a )9a since g a = ( a . □ 

The change of basis matrix for {gp} to {Cp} is triangular; define B by 
(3.2) 0=^5(7,/?)^, then £(7,7) = 1, 

and 5(7, 0) = unless 7^/3. The usual proof (for {uip} and {Cp}) applies. There is a nice 
relationship between B and the Gram matrix for {gp}- 

Definition 3.8 For /3, 7 E Sia, let 

H((3,j) := (gp,g,)/\\g a \\ 2 

(independent of choice of permissible inner product) . 

Proposition 3.9 Forw\,W2 E Si, and (3,j E Sia, 
in particular, 

H(wia,W2a) = H(a,Wi 1 W2<y) = B (a,Wi W2a). 
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Proof. The first identity follows from the Sjv-invariance of the inner product. For (3 G Sja, 
(by orthogonality, g a = ( a ). □ 



Sahi |^a[] found a formula for \\Cp\\p in terms of a hook length product associated to the 
Ferrers diagram of the composition (3. Here we give an expression whose complexity is roughly 
the number of adjacent transpositions needed to transform a to /3; the upper and lower hook 
length products for partitions (Stanley f3t|| ) will also be used eventually. 

Definition 3.10 For e = + or — ("sign"), an interval I, (3 G Mn, let 

W/):=n{ 1 + K . (/?) -^) : A<&, ^Ue/}. 

Observe 8 e (a,I) = 1 (a satisfies (>,/)). 
Lemma 3.11 If > /or £+l<z<£ + m, t/ien 

S e ((i, i + l)/3, I)/£ e (/3, J) = 1 + ^ e = ±. 

N(P) - «i+l(PJ 

Proo/. For C I let t(/3;i, j) = 1 + Kj(J3 y Km if A < and i < j, else t(/3; z, j) = 1. 

Recall 

Kj (P) = Nk- k{#{s : p a > (3 3 ) + #{s : s < j, (3 S = (3,}) + ft + 1, 

each j. 

Let a = + 1). Then t(a(3; z", j) = £(/3; i + 1, j) and t(cr/3; i + l,j) = t([3; for j > i + 1; 
t(cr/3; j, z) = £(/3; j, z + 1) and t(a(3;j, i + 1) = £(/?; j, z) for j < z. Also £(/3; z", z + 1) = 1, and 

^(CT/?; I, l + 1) = 1 + — rr — rr = 1 + 



/c i+ i(cr/3) - Ki(a(3) Ki((3) - K i+1 (f3) ' 

The values t(j3;j 1 ,j 2 ) = t(aP;ji,j 2 ) for indices (ji,j2) not listed above. Since S e ((3;I) = 
Yii hj) this shows £ e (cr(3; I)/E e ((3; I) has the specified value. □ 

Proposition 3.12 Suppose (3 G Sja, then 

Ui N ) = £4P;i)Ui N ), 

and 

S + ((3; 1)84(3; I)\\U\ 2 . 
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Proof. Corollary 2.11 showed that 

\\CapW 2 _ S + (aP;I)S.(aP; I) 

for Pi > Pi+i, £ + l<i<£ + m, and a := (i, i + The transpositions (i, i + 1) generate Sj. 
Similarly, (p(l N ) / £_(P; I) is constant on Sict. □ 

Observe that the case I = [1,7V] provides the values HC^II VIICa|| 2 and C/3(1 JV )/Ca(1 7V ) for 
\ = p+. 

The minimum (for y) element in Sja occurs in several important formulas. It is denoted 

by 

a := (ai, . . . ,a>e, ae +m , c^ +m _i, . . . , ae+i, a>e +m+ i, . . . , ajvj, 

that is, a R = aja where 07 is the longest element in Sj (the length of a permutation is 
the minimum number of adjacent transpositions needed to produce it, as a product). Thus 
a i = (£ + m, £ + 1)(£ + m — 1, £ + 2) . . . and is an involution, a] = 1. 

Lemma 3.13 

£Ja R ; I) = TT j H — — — — — : £ + 1 < i < j < £ + m and a f > a,- 1 . 

- LJ - [ m(a) - Kj(a) J 

Proof. When ai = ccj+i for some i 6 I, then the list of eigenvalues K£+i(a R ), . . . , /t£ +m (o; i? ) 
is not the reverse of the list Ke+i(a), . . . , Ke+ m (cx), nevertheless the relative order of pairwise 
different values is reversed; that is, af > a R if and only if a2e+ m +i-i > &2e+m+i~j (for £ + 1 < 
j < i < £ + m). This suffices to establish the formula. □ 

As an example for the case ctj = ctj+i, take £ = 0, m — 3, and ct = (aii, cti, 013) with a\ > a^; 
then Ki(a R ) = Ks(a), K 2 {a R ) = Ki(ai), ^3(0;^) = ^(a)- 

There is a unique Sj-invariant in X, and if a satisfies (>, I) there is a unique Sj-alternating 
polynomial in X. Invariance for Sj means wf = /, "alternating" means wf = sgn(w)f, for 
all w G Sj. To establish such properties it suffices to show + 1)/ = / for invariance, 
(i, i + 1)/ = — / for alternating, for £ + 1 < % < £ + m. 



Definition 3.14 Let 



and 



provided a satisfies (>,/). 



j a;I :=£ + (a R ;I) ^ - 1 fa 

c 1 r t\ \ ^ sgniw) 
a a ,:=£4a ; J) ^ U 



Theorem 3.15 T/ie polynomials j a -i and a a -i have the following properties: 
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(1) wj a .i = ja-i for w e Si; 

(2) || Ja;/ || 2 = (#^)^K;/)IIC a || 2 ; 

(3) Ja;I a N ) = (#Sia)Ui N ); 

(4) ja;I = J2/3eS ia 9(3,' 

(5) wa a .i = (sgn w)a a;I for w e Si; 

(6) |k ;/ || 2 = (#s 7 )M«V)IICa|| 2 ; 

(7) a a .j = J2 weSl (sgn w )9wa- 

Proof. It is clear that the polynomials defined in (4) and (7) are the only (up to scalar 
multiple) invariant and alternating elements of X. To show (1) and (5), consider a typical 
element / = ^2p e s ia fpCfii an d fix i with £+l<i<£ + m, and let a = + Then 

/ = XXfeO?: A = A+i, PeSia} 

+ ^{fptfi + UpCrp ■ Pi > Pi+i, P e S r a}. 
By Corollary 2.12, o~f — f if and only if 

Up = S + (J3;I) = ( k 
fp S + (aP;I) V Ki{P) - K i+1 {P) 

for each ft e 5/0; with > /3 i+1 ; also a/ = — / if and only if = implies fp = and 
/3j > implies 

~ £-{o-p-jy 

Note if ct does not satisfy (>,/) then there is no nonzero alternating element. By the trian- 
gularity of B, the coefficient of g a a in j a I or a a -i is the same as the coefficient of ( a n; this 
establishes (4) and (7). 

To compute ||ja,/|| 2 , observe that (gp, J2-yeS ia 9j) = (ffa,£) 7 7 ) for each P e s i a h Y the 
^Ar-invariance of the inner product. Sum this equation over all $ G S/oi to obtain 

(ja;I,ja;l) = {( a , j a -l) = I) \\C a \\ 2 

(using the original definition of j a j). 

Formula (3) is a direct consequence of (4). The calculation for ||a a; /|| 2 proceeds similarly: 

|| a a ; /|| 2 = sgn(wi)sgn(w 2 )(5 l 

WiESi W2&Si 
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= (#<S/)(Ca,<W) 

= (#Sj)£4a R ;I)\\C a \\ 2 
(replacing w 2 by u>iu? 2 in the inner sum.) □ 
Corollary 3.16 

H(a,(3) = £ + (a R ;I), 

and if a satisfies (>,/), t/ien 

sgn(w)H(a,wa) = £-(a R ; I). 

Proof. By definition of i?, 



5^ H ( a >P) = (9a,^2gp)/\\9a\\ 2 = (g a ,ja;l)/H 



2 

all ' 



and 

sgn(»#(a,u>a) = (g a , a a .j) /\\g a \\ 2 . □ 



The triangularity argument for extracting the coefficient of ( a n was used already by Baker, 
Dunkl, and Forrester PDF|| in the same context. Earlier, Baker and Forrester [pF2|] considered 
some special cases of subgroup invariance and relations to the Jack polynomials. 

An analogue of evaluation at 1^ for a a -j will be discussed later. Hook length products are 
used in the norm calculations. 

Definition 3.17 For a partition A and parameter t, let 

N-mo Xi 

h(\,t):= Yl Yl(K-]+t + k#{s : s > i and 3 < A s < A*}), 
i=i j=i 

where Aj = for i > N — m . The special cases t = 1, k satisfy AH A '/i(A, 1) = h*(X), 
AH a '/i(A, k) = /i*(A) ; the upper and lower hook length products for parameter 1/k (Stanley 
f^j), respectively. 
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In the next paragraphs, let / = [1, N], and let A be a partition and X R = (Ajv, Ajv-i, • • • , Ai). 
We will use known results for the Jack polynomials to determine ||Cx||% ; these are due to Stanley 
|St|l. Sahi first found ||Ca|Ip, and recently Baker and Forrester [BF4j] presented a concise self- 
contained determination of the structural constants of the Jack polynomials. 

We apply the previous results of this section and we suppress the letter / in jx-i and £ s (ft; I) 
since I =[1,N]. 

iFrom the orthogonality relations on the iV-torus (more on this later), it is known that 
J\(x;l/k) is a multiple of j\ (where J x is the standard Jack polynomial). Stanley showed 
J x (l N ; 1/Jfe) = (Nk)xk-^, also in (|D|, Proposition 4.3) we showed ( x (l N ) = uj x (1 n ) = (Nk + 
l)\/h(\, 1), so for any ft G A/jv, by Proposition 3.12, 

(3.3) ( P (1 N ) = £^(ft)(Nk + l)f3 + /h(ft + , 1). 

Thus by Theorem 3.15(3), 

J,(x- Ilk) - (^MM) h(x ) 

Note #Sn A = #{/?: ft + = A}, the dimension of E x . The X F formula for Jack polynomials 
(Yan |[Yn|| , Beerends and Opdam ||BO|| ) asserts 

fr a -xr (7Vfc+1) = V {Nk + 1)x Jx (x- - 

1=1 XcAfP V ' y ' V 



We convert this to an expression in j\. 
Lemma 3.18 



_ (Nk) x £ + (X R )h(X,k + l) 
[ ' ] (Nk + 1) X (#S N X) 

N ' 

Proof. We will show 

h(X,k)(Nk+l) x £ + (X R ) 



for X e Nf 



h(X,k + l)(Nk) x #S N X' 

Denote the factors of h(X, t) by h(i, j] t) = Aj — j +t + k#{s : j < X s < Aj}, 1 < j < Aj. Then 
h(i,j,k) = h(i,j + l,k + l) whenever j ^ X s for any s. The ratio h(X,k)/h(X,k + 1), after 
cancellation, is a product of factors like h(i, Aj, k)/h(i, 1, k+ 1) and h(i, X s , k)/h(i, X s + l,k+ 1), 
for X s < Aj. 

We have h(i, Aj, k) = k(l + #{s : s > i, X s = Aj}) and 

h(i,l,k + l) = Xi + k + k#{s: s > i, 1 < X s < Aj} 
= Aj + fc^-mo-i+l), 
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where m is the number of zero parts of A (as element of A/jv)- For each j e Z + , let = #{2 : 
Ai = j'}, then 

N—mo 

H h(i,\i,k) = k N - m °Y[' 
i=i j>i 



rriji 



Also, 



(Nk + l) x N jj° A, + (N - i + l)k 



(Nk) x f = \ k(N-i + 1) 

| N-mo 

"'»■ J] (A, • S A / • 1 )/,•). 



i=l 



Thus 

h(X,k)(Nk + l) x 
h(X,k + l)(Nk) x 



W Uj>i m j ] - jj / Xi - Xj + fc(l + #{s : s>i, Xj <X S < Xi}) 



m f = \ 11 I \ - \ + K l + #{ s : s > i, Xj < X s < Xi}) 



: distinct values of Xj < Xi }. 



In the latter product Aj = is used; it contributes 

Xi + k(N-i + l) 



Xi + k(N-m -i + 1)' 
Since #SjvA = N\/ ]T . rrij\ it suffices to identify the remaining product with 

Let Hi,^ be two distinct values in (Ai, A2, . . . , Ajv) with Hi > /i 2 ; supose A ai = A ai+ i = 
••• = A ai+ni _i = ji\ and X a2 = ■■■ = A a2+n2 _i = // 2 (and no other appearances of /ii,A* 2 ) 
and ai + ni — 1 < a 2 . This implies K t (X) = (N — t + l)k + fj,± + 1, a\ < t < a\ + rt\ and 
«u(A) = (AT - u + l)fc + /i 2 + 1, a 2 < u < a 2 + n 2 . 

The contribution of pair (/!i,/i 2 ) to the left-hand product is 

ai TT 1 /Ul _ ^ 2 + + n 2 - ^) 
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n-TT /il ~ /i 2 + k(u + 1 - t) 
Hi - H2 + k(u - 1) 

t=a\ u=a,2 



n 



«t(A) - « U (A) + fc 



«t(A) - «„(A) 

which is exactly the contribution of (fii,^) to ^(A^). □ 
Proposition 3.19 



N 



lid - *i) HNt+1) = £ m'ffnrU AW (N < 1 «"* 0- 



/i(A, fe + 1)£ + (A K ) 



Proof. This is exactly the i_F series with /i(A, fc) replaced using the lemma. □ 
Corollary 3.20 For A G tfg, ||Ca||* = ■ 
Proof. By the definition of the p-inner product, 



/3gA/jv "^ p "P 

Set y = ljv, and use HOjUJ = S+(/3)£-(/3) \\( x \\ 2 p , 

( (l N ) = £4P)Cx(i N ) = £-(P)(Nk + l) x /h(X, l), 

for A = (3 + . This shows 

^ IICa||^(A,i) 4- £+(/?) 



v (jVfe + 1) A . 

2-^ ||Ca|Ip^ /x 1 ]F ' x/>> ■ ' /A 



'JV 



||Ca||^(A,1)^ + (A^) 

Match up the coefficients with the i-F -expansion. □ 

The value of ||Ca|Ip was first obtained by Sahi who used a recurrence relation (lowering the 
degree). 

There is one more important S^r-invariant inner product for which TjXj is self-adjoint, 1 < 
i < N, obtained by considering polynomials as (analytic) functions on the torus in (see 
Proposition 4.2). 
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Definition 3.21 For f,g polynomials with coefficients in Q(k), let 
T(k + 1) N 



(3-4) (f,g) T :-- 



(27r) N T(Nk + 1) Jjn 



f(x)g v (x) 



l<j<i<N 



dm(x) 



where g v (x) := g(x 1 , x 2 1 , . . . , x N x ), dm(x) = dQ\ ■ ■ ■ d9^ and Xj = exp(\/^l 9j) , — n < 9j < n, 
l<j<N. 

Beerends and Opdam |[BO|| evaluated ( J\, J\)r, from which one can deduce: For A G Affi, 
9 e E x , 

|2 (Nk + l) x .. ||2 



\9\h 



((N-l)k + l) x 



\9\ 



Baker and Forrester [ BFBfl computed || Colli with a different method. 



4 Subgroup alternating polynomials 

Whenever a polynomial is skew-symmetric for a parabolic subgroup of Sn it is divisible by an 
appropriate minimal alternating polynomial (a product of discriminants). The evaluation of 
the quotient at x = 1 N is a generalization of the Weyl dimension formula. This evaluation for 
polynomials in E\ (A G Af£) will be carried out in this section, by constructing for each interval 
/ C [1, N] a skew operator ipj with at least these properties: 

(1) ipiw = sgn(w)wipi, for w G 5j; 

(2) [ipj, Uj] — for j £ I; 

(3) if Ji is an interval disjoint from /, then [ipi,w] = for w G S^; 

(4) if a G A/jv and satisfies (>,/), then maps span{C™ a: w G S/} to itself. 

Heuristically, one might suspect ni<j( r i ~~ T j) works, but it is not skew because of non- 
commutativity, and Yli<j{Ui — Uj) has the wrong transformation properties (for (#/) > 3). 

Definition 4.1 For an interval I, let aj denote the minimal alternating polynomial for I , that 
is, ai(x) := H{xi — Xj : i < j and i,j G /}. 

Let Ai denote the associated division symmetrizing operator on polynomials: 

Mf{x) : = y^rrj Yl sgn(w)f(xw)/a I (x). 

For a satisfying (>, /) we will evaluate the functional (Aia a -i)(l N ), in fact, the more general 
situation for a collection of disjoint intervals ((A^A^ ■ ■ -)f)(l N ), for suitable /. 
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We will impose one more condition on ipi, which, surprisingly, is enough to determine the 
restriction to X uniquely. We will also construct an operator on X, using the Gram matrix H, 
satisfying the conditions; this will allow the determination of the matrix entries for xjjj in the 
basis {g wa : w & Si}. 

The aforementioned condition comes from the idea of a "reversing" transformation: the 
requirement that ipi( wa is a simultaneous eigenvector of t; l — k YLi<j<e+m(^)^ for £ < i < £ + m. 
Note that Ui = t { — fc^<j<i(u)> so this reverses the interval I. 

Definition 4.2 For i G I, let Q { := n - § Ej^e/tX?)- 

We show later that if ipj is skew and [ipi, 9,j] = for each j G /, then ■?/>/ has the reversing 
property. 

Fix a satisfying (>,/), I = [£ + 1, 1 + m] and X = span{<7 TOQ : w G Si} = span{( wa : w G 
Si}. 

For a linear transformation A on X we use the matrix notation Agp = J2 jeSia A(j, f3)g T 

Lemma 4.3 The linear transformation A on X is skew if and only ifA(wia, u^a) = sgn(w\) c(w : [ 1 W2) 
for some function c on Si. 

Proof. Given the function c define A as indicated (Recall ui\ ^ W2 implies w±a ^ W2®). 
The transformation A is skew if and only if (sgn uii)w\Ag W2a = Aw\g W2a for each W\,W2 G Si, 
that is 

sgn(^i) ^2 A(wa,w 2 a)w 1 g wa = sgn(iui) ^ A(w^ 1 wa,w 2 a)g wa 

= A(wa,w 1 w 2 a)g wa . 

Matching up coefficients of g wa shows that A is skew if and only if 

sgn(iui) A(wi 1 wa, u^ce) = A{wa,w\W2Ct) 
for all w,wi,W2 G Si, consistent with the relation 

A(wa, Wiw 2 a) = sgn(w)c(w~ 1 WiW2). n 

Corollary 4.4 With the same hypotheses, 

Aa a .j = s 9n{w)c{w))j a .i 

and 

Aj a -i = (Yl c{w))a a -i. 
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Proof. By Definition 3.10, 

Aa a;I = sgn(w2)A(w 1 a 1 w 2 a)g wl a 



Wl W2 



^Qwia ^sgn(w 2 )c(w 1 1 w 2 )sgn(wi) 



Wl \ W2 



= Yl 9w ^ a [ Yl s g n ( u, 3)c(w 3 ) J , 



changing the second summation variable W2 = W1W3. A similar argument shows Aj a -i = 

Two more relations apply when a satisfies (>,/): 

(4.1) Kiiwa) = n w -i(i)(a), for i E I, w G Sf, 

(4.2) S e {wa; I)S t {o- lW a; I) = S t {a R ; I), for w G Si, e = ±. 

For the second equation, note for any given wa, and £ + 1 < i < j < I + m, the term 
1 + appears in £ e (wa; I) if w(j) < w(i), else in £ e {ajwa; I); note (wa) w ^ = ai. 

Lemma 4.5 Suppose a satisfies (>,/), then 

k \ 

for [3 G Sj-a;. 

Proof. By Proposition 3.5, 

A; 

k x 

The case $ = /3j cannot occur. □ 

The first important example of a skew operator commuting with each 6i is defined using the 
Gram matrix for H; thus the domain is just the space X (for a given a satisfying (>,/)). 

Let P be the operator on X with the matrix P(w\a,W2a) = sga(wi)S WuW2 ("P" suggests 
parity). Note that P 2 = 1. 

Proposition 4.6 T/ze operator on X with the matrix PH is skew and [PH, 6j\ = for i G I. 
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Proof. Let Ai be the matrix for 9i in the basis {g wa : w G Si}. By the lemma, ^(7, (3) = 
k'^P) if 7 = P, and = | sgn(/? i - if 7 = and = else. Thus ^(7, P) — unless 7 = /3 
or 7 = (r/')/3 for some j 6 /, j ^ i This shows PAiP = Af (T for transpose), since 

(PAjP) (tuia, u? 2 a) = sgn(wi)sgn(w 2 )Ai(wio;, u> 2 a), 

thus 

(PAiP)((ij)P,P) = -M(ij)P,P), for /? G Sia. 

Also #j is self-adjoint and H is a scalar multiple of the Gram matrix for {g wa '■ w G Si}, 
hence AfH = HA h that is PAiPH = HAi and AiPH = PHAi. 

The operator PH is skew by the lemma (and H(w\Ol, w 2 ol) = H(a,w^ 1 w 2 a), Wi,w 2 
eSi). □ 

Proposition 4.7 Suppose A is a skew operator on X, corresponding to the function c on Si, 
then [A, 0j] = for each i G / if and only if 

k \ -v 

(di(wa) - K > i {a))c{w) = - 22 c((ij)w)(sgn(i - 3) + sgniw^d) - w' 1 ^))), 

for each w G Si, i G I. 
Proof. For a linear transformation A on X the condition [A, 9j\ = is equivalent to 

k'M A( 7 , P) + \Y, sgn(& - A)^(7, (y )£) 

= ^(7)^(7, /3) + k - s S n (7* - 7i)^((u)7, 

(7,/? G Sia,j G /). Let 7 = w±a, P = w 2 a and replace A(wia, w 2 a) by sgn(wi)c(w^ 1 w 2 ) . The 
equation becomes 

(/t-(u> 2 a) - K / i (w 1 a))sgn(w 1 )c(w^ 1 w 2 ) 

= 2 s S n ( w i) c ( u, r 1 ( u, i( i o),Wi(j ))w 2 )(sgn(i - jo) 

+ sgn(w^ 1 w 1 (j ) - w^^i^o))), 

where « — ^i^W? Jo = w \ 1 {j)- Canceling out sgn(u>i) gives an equation depending only 
on w := w^ x w 2 and i 0) because K , i (w2(x) = K ' Wl (i )( w 2<^) = K i ( wa ) an d ^(ifia) = ^ (a). 
This is the equation in the statement. Note for any w G Si, i G /, k^(oi) = k^^to), and 
sgn(«i - oij) = -sgn(j - i), for i,j G P □ 



23 



Corollary 4.8 If A is skew and [A, = for each i & I, and k > 0, then the values c(w) are 
uniquely determined for given c(l), w G Si. 

Proof. A certain subset of the equations in the proposition is extracted. For any w ^ 1 there 
is a unique i G / so that w(j) = j for j < i and u> _1 (i) > i. Specialize the equations to these 
values of w,i; sgn(i — j) + sgn(w~ 1 (j) — u> _1 (i)) ^ exactly when i < j and ■u; _1 (i) > w~ l (j) 
(by construction j < i implies < w -1 ^)). 

Thus 

^ K i( a )) c ( w ) = -k^2{c((ij)w) : > i < j < £ + m}. 

The coefficient of c(w) is nonzero, and if (5 — (ij)wa with > then /3 >- wa. 

Thus c(iu) is uniquely determined in terms of the values {c(wi) : w\a >- wa, ui\ G Si} when 
k^O. □ 

This corollary shows that an operator on polynomials that is skew for Si and commutes 
with 9 i: i E I is determined on each X (= span{w( a : w G S/}, a satisfies (>,/)) as a 
scalar multiple of PH. We derive some equations which will be instrumental in computing the 
multiple. 

Proposition 4.9 Suppose A is a skew linear operator on X and [A, 9j\ = for each % G /, 
then there is a constant b such that A = bPH and 

(1) Aj a;I = b£+(a R ;I)a a .j; 

(2) Aa a ,i = b£_(a R ;I)j aJ ; 

(3) A( wa = b sgn(w)£ + (wa; I)cri( aiwa , form G Si; 

(4) A 2 = b 2 S + (a R ;I)S4a R ;I)l. 

Proof. The fact that A is a scalar multiple of PH follows from Corollary 4.8 and Proposition 
4.6. Equations (1) and (2) follow from Corollary 3.16 and Lemma 4.4. We prove (3) by 
exhibiting a simultaneous eigenvector structure for {cri( wa : w G /} and its relation to A. 
For % G /, let U R = n~k Sj<j<^ +m (u), then aiU ai ^ai = U R (note 07 (i) = 2m + £+ 1 -i). 



Further U R A = AU t , indeed U t = Oi + ^ jeIJ ^aga{j and U R = 9, - \ J2 je ij& s § n 0' " 



i)(ij), and [A, 0*] = 0, = —(ij)A by hypothesis. For w G 5/, crj-A^a is an eigenvector 

of U ai (i) with eigenvalue ^(wa), each i E I, because /ti(u>a:) A£ WQ = Af/jCwa = U R A(, wa = 
o~iU ai u-)(o~iA£ wa ). Since fjj(ioa) = K ai (j\(o~iwa), this shows there is a constant w(w) so that 
o~iA( wa = v(w)( aiwa , each iu G 5/. We use (1) to find v(w); on the one hand 



Aa a .j = 



b£_{a R -I)j a ,i 



b£_(a R ] I)a T j a .i 
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on the other hand 

a n i r T \ sr^ sgn(w) , . 
Aa a -i = £-{a ; I) } — v{w)a I Q IaWa . 

In the first equation, change the summation variable to <JiW, and match up coefficients of a/a, 
in the two equations; this shows 

v(w) = b sgn(w)£~(wa; I)£ + (a R ; I)/£ + (ajwa; I) = b sgn(w)£-(wa; I)£ + (wa; I) 

(by (4.2)). Finally, 

A 2 ( wa = b 2 sgn(a I )v(w)a I A( aiWa 
- b 2 sgn(ai)v(w)v(aiw)( wa 
= b 2 £ + (a R ; I)£-(a R ; I)( wa: w e S t . □ 



We construct a skew operator commuting with each 9i, i G in the algebra generated by 
{"Tj : i G /} U Sj, by induction on the size of the interval. 

Definition 4.10 For the interval I = [£ + 1,£ + m] and 1 < s < m, letipi\=l, 
i) s+ i := U i+1 U i+2 ■ ■ ■ U i+S ij s ; 

i+s 

ip s +i ■= 4> s +i- + s + l)4> s+1 (ij + s + l). 

i=e+i 

Then ipi '■= VVn- 

Theorem 4.11 The operator ipj satisfies 

(1) ipiw = sgn{w)wipi for w G Si; 

(2) ipiw = wipi for w G S[ lt e] x S[ e+m +i,N]; 

(3) [ipi, Uj] = for j I; 

(4) [x(> I A] = 0,forieI; 

(5) for any a satisfying (>,/), span{w( a : w G Si} is an invariant subspace ofipi. 
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Proof. Properties (2) and (3) follow immediately from the defintion; and property (5) is a 
consequence of (1). Let (l s ) be the condition tp 8 (ij) = —(ij)ip 8 for I + I < i < j < £ + s, and 
(•Is) be 

k ^ 

^n-- 22 =0 - 

The case s = 1 is trivial. Inductively, suppose (l s ) and (4 S ) are true. For convenience, let 
t = £+s+l: then (ij)ip s +i = ~^s+i{ij) for £+1 < i < j < £+s, because [Ue+i ■ ■ ■ Ue +S , (ij)] = 
(see Proposition 3.7). Now evaluate (ij)ip s +i(ij) using the definition; each term in the sum is 
transformed to the negative of the corresponding term in ip s +i, with the exception of the terms 
labeled i and j which are also interchanged; note (i,j)(i,t) = (j,t)(i,j). It suffices to show 
(£+s, t)ip s+ i(£+s, t) = —ipg+i] again the terms in the sum correspond to the negatives, example: 
(£ + s,t){i,t)$ 8+1 {i,t)(£ + s,t) =_(i,t)(i,e + s)ij> 8+1 (i,e + s)(i,t) = -(i,t)$ 8+1 (i,t). The other 
part is {£ + s, t)(tp 8+ i — {£ + s, t)ip s+ i(£ + s, t))(£ + s,t). This shows (l s +i). 

To show (4 S+1 ), let Bj := Tj - |ES+i,^(u)> £ + 1 < j < £ + s + 1. Then for 
j < £ + s, [ip s+ i,Bj] = by (4 S ) and [C/^+i • • • Ue +8 , Bj] = 0; the latter follows from Tj = 
(£ + l,j)U e+1 (£ + l,j) and U e+1 ■ ■ ■ U e+8 commutes with U e+1 and w G S [£+1/+s] . 

It will suffice to show [V's+i, B t ] = since 



k 



{j,t)B t {j,t)=Tj-- J2 (^')- 



For £ + 1 < i < £ + s, 



i=e+i,ijtj 



[(i,t)$ a+1 (i,t),B t ] 



{i,t)[$ 8+1 ,(i,t)B t (i,t)](i,t) 



= (M) 



ip s +i,Bi - -(i,t) 



(i,t) 



Also [ip 8 +i, U t ] = by (3), that is, 



k 

~0 (»,*)[&+!, (*,*)](*>*) 



k ~ 

-[ip 8+1 ,(it)}. 



£+s 

$8+i, n - k (M) 

i=l+l 



o, 



equivalently, 



i+s 



[$8+i, B t ] = - ^ [^ s + lj 



i=l+l 
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This shows 



e+s 



^s+i - Yl (ht)i> s +i(i,t),B t 



0. □ 



i=t+l 



Theorem 4.12 Suppose a satisfies (>,/), then 

ip^X = U{Ki(a) - Kj(a) : £ + 1 <i < j <£ + m}PH. 

Proof. By 4.9, PH( a = o~j( aia ; thus it suffices to compute the coefficient of ( aia in o-iipi( a - 
We use the inductive framework from Definition 4.10 and Theorem 4.11. For fixed s < m, let 
o"o, o~i be the reversing permutations for the intervals [£ + 1, £ + s] , [£ + 1, £ + s + 1] respectively. 
The inductive hypothesis is that 

^C 7 = II (^( 7 ) ~ K i(7)) (T oC<7„ 7 
e+i<i<j<e+s 

for any 7 satisfying (>,[£ + 1,£ + sj) (trivial for s = 1). Fix a satisfying (>,/); let 
7i> := — Kj(a) : £ + 1 < i < j < £ + s + 1, i ^ r, j ^ r}, 

and 

< := : £ + l<i<£ + s + l, i^r}. 

For £ + 1 < j < £ + s + 1, let be the cycle {£ + s + 1, £ + s, . . . , j + 1, j) in S^+i^ +s+ i]. In 
the notation of Definition 4.10, 

e+s+i 

j=£+l 

because = (£ + s,£ + s — 1, . . . , j)(j,£+l + s) (in cycle notation) and sgn(w^)) = £+s + l— j; 

coming from the skew property of i/) s +i f° r S^+i.m-s]- 
Let a(j) = w^a; thus 

a (j) = • • • > a M-i> a €+2, • • • , ttj-i, <Xj+i, ■ ■ ■ , tt£+s+ij 01 j, ae +s+2 , ■ ■ ■), 

which satisfies (>, [£ + 1,£ + s}). We claim the coefficient of ( aia in aiw^ip s+ iw^j)( a is 7^7^. 
By a standard identity for alternating polynomials 

g (-l)^+i-% jVr ; = J] (««(«) - «,-(«)). 

j=£+l £+l<i<j<^+s+l 

To establish the claim: 

«>(j)Ca = Ca 0) + {&(t)C 7 : 7 e and 7 >- 
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(the triangularity of the matrix relating the bases {( wa } and {w( a }). By the inductive hypoth- 
esis and 

for some coefficients b'(^). But 

viw^ao = w^ d) (a 1 (j) = 2e + s + 2-j), 
which fixes \t + 1, 2£ + s + 1 — j] pointwise, which shows that 

^iW(~)<7oCto7 e sp an {C«xT 7 : w e S{ 2 e+ s +2-j,e+s+i}}- 

Now (cr j) e+s+1 = 7£ +s+ i G {a j+1 , a e+s+1 }, because 7 >- w^a; hence for any (3 = wa j in 
this span, there must be an element of {<x,+i, . . . , a£ +s+ i} not appearing in {(3e+i> . . . , foe+s+i-j}, 
thus (3 7^ a±a. 

The argument will be finished once it is shown that the coefficient of ( aia in the {( wa } 
expansion of w _1 Cwia is 1 ; i n the notation of (3.1), 



I Qwa\oi ~^ 



= ^<ria + 5^-B(7>^l«)^«;-i7; 

7 

7 >- u><7iCK implies u> _1 7 7^ o"ia, the minimality of <j\Oi shows the coefficient of ( aia in the 
right-hand side is 1. □ 

Corollary 4.13 

ipia a -j= J] (Ki(a) - Kj(a) - k)j aJ . 
e+i<i<j<e+m 

Proof. Yli<j( K i( a ) ~ Kj(a))£-(a R ; I) has the specified value; see Lemma 3.13. □ 

We return to the problem of evaluating Aif(l N ). The proof of the following comes later. 

Theorem 4.14 Suppose {ii, I 2 , ■ ■ ■ , It} is a collection of disjoint subintervals of [1, N], rrii : = 
#7 i; 1 < i < t and f is a polynomial, then 

{AhAh ' ' ' A,J)ilN) = (^ + i>!nu m .! {M ' h ' ' ' i%m% 

where \i = (mi — 1, mi — 2, . . . , 1, 0, m 2 — 1, . . . , 0, . . . , m t — 1, . . . , 1, 0, . . .) + . 
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In the sequel, for an operator A on polynomials, A* denotes the adjoint with respect to the 
p-inner product. 

Let l{x) := riili(l ~ Xi)"^ 1 '^, then (/, l) p = f(l N ) for any polynomial /; more generally, 
(/, F k ( • , z)) p = f(z). Let Ul := Xi /(1 - a*), 1 < i < N. 

Lemma 4.15 

t , V JV 

^ • -aiaz) = n ( *m) ri( i - ^r (Nk+i) - 

Proof. First apply Ai to F k (x,z) with respect to z. Without loss of generality, assume 
Ij = [l,m] (with m = m,j); then 

, P , , i I sr ^gn(^) \ rr n ,- 1 n- J=1 ( 1 -^)" fe 
m! L^i ni=l( " / ^ a[1 ' m]{z) 



I m AT JV 



i,j=l j=m+l »,j=l 

where the sum evaluates to a>[i,m]( x ) a [i,m]( z )/ TiTj=i(^ ~ x i z i) by an identity of Cauchy (this 
identity was used by Baker and Forrester [BF4] in a similar calculation). Because the intervals 
are disjoint, 

t 

A h A h ■ ■■A It F k (x, z) = Yl K(x, z)F k (x, z), 

r=l 

where 



h r (x,z) = — a Ir (x) TT{(1 - XtZj) 1 : i,jel r ,i^j}. 
To find A\ ■ ■ • A* It L put z = 1 N in this formula; note 

h r (x, 1 N ) = —^{x) IJ(1 " ^)" (mi " 1) = — } a Ir (u). 



i€l r 



The operators are generated by \TiPi : i <E 1} and transpositions. Recall TiPi = TiXi + k. 
Write T" to denote action in the variable (u±, u 2 , ■ ■ .)• 

Lemma 4.16 Suppose f is a polynomial in u, then 

(T iXi + k)(f(u)t(x)) = ((1 + ^)(7>* + k)f(u))t(x), l<t<N. 
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Proof. The product rule Ti{h{x)i{x)) = {Tih{x))i{x) + h{x)jr^- applies because t(x) is 
S , 7v-invariant. The chain rule implies 

[(T,* ( + *)(/(„).(*))] _ + + + + + S/(») 



+ Uj)f(u) - Uj(l + Ui)f(u(ij)) 



(note Xi = UiJ (1 + Ui)). The typical term in the sum equals 



i i x / Uif(u)-Ujf(u{ij)) \ 

l + Ui)[ )-Uif[U). □ 



U{ — 



The effect on / is to raise the degree by 1; in fact, the highest degree term of the operator 
coincides with T t u * = Ui(T t u Ul + k) ( P3| , Proposition 4.1). 

Lemma 4.17 For an interval I = [£ + 1, £ + m] and a polynomial f(u) of degree t, 



m{u)i{x)) 



II (T:-T*)f(u) + h(u) 
,e+i<i<j<e+m 



l(x), 



where f\{u) is a polynomial of degree < t + m(m — l)/2. 



Proof. Using the inductive framework from Theorem 4.11, suppose the statement is true 
for the interval [£ + 1,£ + s] (trivial for s = 1). In the notation of Definition 4.10, VC+i = 
ip*(U i+1 ■ ■ ■ U i+S )* and by Lemma 4.16, 



u*(f(uXx)) = ((i + + k)f(u) - k f«m 



L(X) 



j<i 



which has the same highest degree terms as (T*f(u))t(x). By the commutativity of {T*}, the 
highest degree term of tpl +1 (f(u)t(x)) is 



e+s 



U T * II (T*-T*)f(u)U(x) 
\i=e+i e+i<i<j<e+s / 

(inductive hypothesis). Finally 

e+s 

Cfi = ft-i - J2^ i + S + Vti+iih £ + s + 1); 

i=i+l 



and the usual identity for a^ + i^ +s+ i] finishes the proof; since 

(i,£ + s + l)T*(i,£ + s + l) = T; +s+1 . 



□ 
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Lemma 4.18 

Il^i ) ^ = CiYla h (u)L(x) 



v i=l / i=l 



for some constant cj. 

Proof. By the previous lemma, 

i(x) 



fo(u) + h(u), 



where f Q (u) = Hl^ a h (T*)l and deg fi < J2t=i m i{ m i ~ Also fo(u) + is skew 

for n!=i Sjj (direct product) by the skew property of which implies /i = and foiu) = 
Cj n!=i a h ( u ) because this is the unique skew polynomial of minimum degree. □ 

Proof of Theorem 4-14- The lemmas show that 

In ( |P3|| , Theorem 3.1) it was shown that Yli a h G f° r A* = ( m i — 1> — 2, . . . , 1, 0, m 2 — 
1, . . . , 1, 0, . . .)+, thus (by Corollary 2.6) 

t t 

n^^^^+ivn^w 

i=i i=i 



(see also ||DH|] ); and so 

t / t \ t 

n^=(iVHi)Jn m » ! n% 

i=l \j=l / i=l 

Corollary 4.19 Suppose a satisfies (>,/«) for each i, 1 < i < t, then 



v i=l w£Si 



Wttv- r?4 u u n nw«) - — k -. i,j&i r , % < j}, 



(Nk + 1), h(a+,l) rl 
where Sj := x Sj 2 ■ ■ ■ x Si t . 
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Proof. Let 7r r = ni^^) — K j( a ) ~ k : i,j G I r , % < j}. For each interval I r , 
4>irY /w es Ir s g n ( w ) w (<* = J2 we s Ir W C*, by Corollary 4.13. Since [4>i r ,w] = for w G Sj 4 
and [■^/rjV'/J = 0, for i 7^ r (Theorem 4.11), 

t t 

r=l w£Si r r=l ujSS/ 

(the sum is a product of sums over Sj 17 . . . ,Si t ). Also 

uj€Si \i=l / 



and 

(by (3.2)). Further 



U1 N ) = (Nk + !)„£_(«, [1, N])/h(a + , 1) 



u>eSi r w£Si r 
(and this is a typical term in the product sum over Sj x x • • • x 5j t ). □ 

5 Orthogonal Polynomials of Type Bjy 

This section deals with operators and orthogonal decompositions associated with the group 
generated by sign-changes and permutations of coordinates. Previously, Baker and Forrester 
BF2|| considered some of the orthogonal polynomials, called generalized Laguerre polynomials. 



These come from polynomials which are even in each coordinate or odd in each coordinate. The 
general situation is developed in the sequel. One consequence is a complete set of eigenfunctions 
for the Hamiltonian of the spin Calogero model (1/r 2 interactions confined in harmonic 
potential), with arbitrary parity, that is, for any subset A C [1,-AT] we find the eigenfunctions 
which are odd in Xj, % G A and even in x^, % ^ A. 

The underlying symmetry group Wn is the Weyl group of type B N , called the hyperocta- 
hedral group. It is generated by permutations of coordinates and sign-changes on ~R N . The 
reflections in Wn are {(Jij,Tij : 1 < i < j < N} and {<jj : 1 < i < N}, defined by 

X&ij ■ ■ ■ . . . ,Xj, . . .), XTij (^l) • • • j . . . , Xj, . . .), XO~i (^l; ■ ■ ■ j • • •)• 

There are two parameters k, k\ in the algebra of differential-difference operators: 
(5.1) lf/ W := *L + k n*)-H*«) 

f(x) - f{x(Tij) f(x) - f(xTij) 



ry . ryt . ryt . I ry . 
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(1 < i < N, for convenience <Jij = <jji, = Tj% for j < i). 

The Sjv-theory can be applied to the analysis of Wn by writing polynomials in the form 
x A g(x\, x\, . . . , x 2 N ) where xa '■= Y\i &A x ii A C [l,iV]. For a composition a let p a (x) : = 
x A pp{x\, ■ ■ ■ i x n) where A = {i : on is odd}, and $ = |_ a i/2j , 1 < i < -/V. Observe 



N N 

53p a ( a r)^=n((i-^r i n( i 

o i=l j'=l 



The raising operator is defined by pip a = p(a\, . . . , Oj+i, . . .). 

We will use y G M. N to denote {x\,x\, ■ ■ ■ and the A-type operators Tj act on y. The 
following properties hold ( |D4| , Prop. 2.1), for A C [1, iV], any polynomial (7 in y: 



(5.2) (<r - + r i:j )x A g(y) 



(5.3) Ttpi{x A g{y)) 



(2x A )(ij)g(y) iJeAoriJ^A, 
else; 

2x A {T i p i g{y)), i G A, 

2x 4 ((A; 1 - fc - + TiPig(y) - k ^2 seA (ij)g(y)), i i A. 



Definition 5.1 For 1 < i < N, U B := T B pi — k^j^io'ij + T ij) acts on polynomials in x. For 
a subset A C [l,N], let 

U A ,i ■= TiPi - k y~]{(ij) ■ j < i and j G A} for i G A, 

U Aji := T iPi + (kx — k — -)1 - k ^{(ij) : j e A or (j A and j < i)} for i <£ A, 
acting on polynomials in y. 

Proposition 5.2 For A C [1,N], Uf(x A g(y)) = 2x A U Aji g(y), 1 < i < N. Also 

\[T*{x A g{y)) = 2# A \[ (u Ai + k 1 -k-^j g(y). 

This proves the commutativity of {U B } in terms of propositions about a direct proof 
is also possible. 

Let V B denote the intertwining operator for Wn, thus T B V B = V B and V B is homoge- 
neous of degree 0; also let £ B be the linear operator on polynomials defined by £ B p a = x a /a\. 
Here is a description of the eigenspace decomposition of V B C, B constructed in [173]. Each space 
is irreducible for the algebra generated by {T B pi : 1 < i < N}. 
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Definition 5.3 A B-partition a is a composition (ai, a 2 , • • • , a at) where the odd and even parts 
are respectively nonincreasing, that is, i < j and aa = ctj mod 2 implies aij > otj . A standard 
B-partition is one in which the odd parts come first (for some £, on is odd for i < £, even for 
i > £). For a G J\f N , let 

h(a) = (|ai/2j, |a 2 /2j,...), 6(a) = [a x - [_ ai /2\,a 2 - [a 2 /2\,...). 

This is an example of a .B-partition: a = (4,5,3,4,2,0,1), and h(a) = (2,2,1,2,1,0,0), 
b(a) = (2, 3, 2, 2, 1, 0, 1). The corresponding standard .B-partition is (5, 3, 1, 4, 4, 2, 0). 

Any .B-partition can be rearranged to a standard one; if a is a .B-partition with £ odd parts, 
then there exists a standard .B-partition a and w G Sn so that wa = a and 1 < i < j < £ or 
£ + l<i<j<N implies w(i) < w(j) (note a w ^ = c^, each i). 

The property of permutations described above will be used several times in the sequel. 

Definition 5.4 For any subset A C [1,N] let w A G Sn be the unique permutation satisfying: 
w A ([l, £}) = A (for £ = #v4), and l<i<j<£or£+l<i<j<N implies w A (i) < w A (j). 
Ifl<£<N, the correspondence A —>■ w A is one-to-one. 



Proposition 5.5 Let A C [1,N], I = #A, then 

U B w A (xix 2 ■ ■ -xig(y)) = w A (2xx ■ ■ ■ xiU[ X ^ s g(y)) 

= w A (Uf (xx ■ ■ -xeg(y))), for 1 < % < N, s = w~ 1 (i). 

Proof. (T^pi)w A = w A T B p sl for s = w~^(i) and (ij)w A = w A (w^ (i) , (j)) for j ^ i. 
The order preserving properties of w A and Proposition 5.5 imply the stated equations. □ 

The proposition shows how to find joint eigenfunctions of {U B } corresponding to arbitrary 
.B-partitions once the standard case is done. 

For a given standard .B-partition a, with being odd exactly when 1 < i < £, let Ge = 

S[i/} x S[ i+ i,N], (3 = h(a), fi = (3 + . Define 

E B = span{xiX2 • • -x^^y) : 7 = w(3, w G Ge}. 



Proposition 5.6 E B is invariant under Ge, U B {x\ ■ ■ ■xe( 1 (y)) = CiX\ ■ ■ -xe^iy), where Ci = 
2«i(7) for ie [l,£], a = 2(^(7) + h - k - |) for i G [£+l,N). 

This follows from Proposition 5.2. To express the eigenvalues of V B ^ B , let 

A(a) := {Nk + l) h{a)+ ((N - l)k + h + -) b{a)+ , 

for a G A/jv- Then E B is an eigenspace for V B i B with eigenvalue 2-^K(a)' 1 . It was shown 
Dj], Proposition 4.2) that x\ ■ ■ -xeCpiy) is an eigenfunction of V B ^ B with this eigenvalue, 



111 



and V £ commutes with w G Wn- 
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Again there are three inner products in which each Uf is self- adjoint, and which are W, 



N~ 



invariant: (1) the p-product, (x a ,pp) p = 5 a/ 3; (2) the -B-product, (f,g)s — f(T B )g(x)\ x=0 
(depends on both parameters); (3) the iV-torus product, 

(f,9)r-=Ck f{x)g{x) Yl \(x 2 j - xf)(xj 2 - xj 2 )\ k dm(x) 
N i<j<e<N 

(same notation as in 3.20; is the normalizing constant). It is obvious that (xA 1 gi(y),XA 2 92(y)) - 
if Ai, A 2 C [1, N] and A\ ^ A 2 , by the WV-invariance (change the sign of for i e A 1 \A 2 
or i G A 2 \ Ai). Further {x Agi(y) , x Agziy)) = (91,92) for the p- or T-products, using the type 
A definition on the right. 

By the results in Section 3, let f(x) — X\ ■ ■ • XiQJy) G E B , then 



\l = \ml = £ + (l)£-(l)Hl\ k + 1)/M 7 + , 1). 
By the same argument as Proposition 2.5, 

(5-4) ||/||| = f(T B )f(x) = 2^A(a)\\(X- 

In IID2II we showed that 



A' 



(5.5) (f,g) B = c k , k , [ {e- L ^f)(e- L ^g)f[\x s \^ ]J \x* - x^e^dx, 

J RN j=l l<i<j<N 

for polynomials f,g where L := YliLii^) 2 (the normalizing constant Ck,k> is chosen to make 
(1, 1)b = 1 and is computed by means of the Macdonald-Selberg integral). Define a generalized 
Hermite polynomial 

(5.6) Hp(x):=e- L l\x X '"X&{y)), 
with 

(3 = (2 7l + 1, . . . , 2 7 , + 1, 2 7/+ i, . . . , 2 lN ) (so 7 = h(J3))- 

The complete orthogonal basis is given by {waH^x) : A C [1, N], i— #A, Pi is odd exactly 
foriG[l,£]}. 

By using the "non-symmetric" binomial coefficients introduced by Baker and Forrester [ B~F3 
we can produce an expression for Hp in terms of {C 7 }; although very little is known about the 
coefficients. 

Definition 5.7 For a G Mn, the binomial coefficients (depending on k) are implicitly defined 
by 



Uy + ± N ) v-M CM 



Ui N ) C 7 (i N Y y 
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It is known that ("j = unless 7 + C a + (that is, (7 + )« < (« + )i, 1 < i < -AT). For any 
scalar s, the homogeneity of C« implies 

When A; = 0, ^"J = (r ) (ordinary binomial coefficients). 

Proposition 5.8 (Baker and Forrester \BF3J ) For a G A/jv, 

■■pfE^M % £ g : ;:a (y-%), 

Proof. The adjoint in the A-inner product of multiplication by exp(sY2iVi) is translation 
g{y) l— *• fl'd/ + sl^). Indeed, suppose / and g are polynomials, then 



9(y)\v=o 



(e s ^f(y),9(y))A = f(T)e s ^g(y)\ y = 

= f(T)g(y + sl N )\ y=0 , 

because YliLi^i = Yli=i The given expression is found by using the A-norms of the 
orthogonal basis elements C 7 (see Corollary 3.19). □ 

The adjoint of e~ sL in the S-product is multiplication by exp ^— s YliLi x \ J > "which can be 
evaluated using the previous result for Cyiv)- F° r P e A/jv, < t < N, let 

£) = (2A + 1, . . . , 2{3 e + 1, 2/3 £+1 , ...,2(3 N ). 

For a e A/jv, sGl, 

m ^ ■ ' ' - £ AlSgiS <^ H% - ■ ' ' 

The formula follows from a similar adjoint-type calculation as in 5.8. Here the norm of the 
orthogonal basis element is 

\\xix 3 .--XiCf,{v)\\% = 2^ +e A(b(P,£))\M 2 p 

= 2 2 I^A(&(/3, £))h((3 + , k + l)£ + (P)£4P)/h(P + , 1) 
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(see (5.4)). Put s = —\ in the formula to produce an orthogonal basis for e l^l 2 / 2 , s = — | 
for e - ^' 2 in the formula (5.5); that is, including all the polynomials wa{xi • • •%tCa{y))i A C 

e = #A. 

The special cases £ = and £ = N have already been obtained by Baker and Forrester 
BF3|| , who called them generalized Laguerre polynomials. 



We discuss the connection to the .B/v-type spin Calogero model in (1.3). 

^From the commutation [L,Xi] = 2Tf ( |pi|| , Proposition 2.2), it follows that e~ L l 2 Xi 



[Xi - Tf)e- L / 2 . Also 



Tfxi = x,{Tf + 1 + 2k x Oi + k y^cr^ + r^), 

which shows that 

e -L/ 2f/ B e L/2 = x{F^ - (Tf) 2 + l + k + {2k, - k)a t +kJ2(*ij + 

The Hermite polynomials from (5.6) (with s = — |) are simultaneous eigenfunctions of these 
operators. Then 

N 

l/2 r^ e L/2 



^3 := e~ L ^U, 



i=i 

N N N 

i=l i=l i=l 

The eigenvalues depend only on the degree and the number of odd indices, 

H 3 e' L/2 (x l ■ ■ ■ x e ( a (x 2 )) = ((2\a\ +£) + 2£(k - k x ) + N(Nk + l + 2k x - k){e~ Ll2 x x ■ ■ ■ x e ( a (x 2 )). 



Let 



then 



h( X )= n \x 2 -x 2 \ k n 

l<i<j<N i=l 



N 

fei 



V ' d d 2 



i d 

h(x)H 3 h(x)' 1 = y~] \ Xj — 



N N , 

• (*!-*)$> • k,^ 



+ 2k v ( *z£sl+ 

^ I (a;. - a;.) 2 (a^ + x ,) 2 J 
l<i<j<N <K 31 K ■>' } 



+ N(k + 1). 
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Conjugating once more leads to 



N 1 
e-^h{x)n 3 h(x)- 1 e^ A = H 2 + (h - k) ^ *i + N(k + -). 



i=l 



The middle term is basically counting the odd indices. Yamamoto already found that the 
eigenvalues were evenly spaced. Baker and Forrester [BF3| studied the A-version of this model 

with a similar transformation, namely exp 

(- Eili ^7 2 ) • Van Die j en H and Kakei HI 
K2|| , |[K3|| have studied the symmetric (M^v-invariant) eigenf unctions of this model. 



The theory of symmetric and alternating polynomials from Sections 3 and 4 can be applied. 
We will only write down the two-interval situation, but the methods apply to finer partitions 
as well. 

Fix an interval [1,^], let Gi = S[x t g] x S[g + i t N], and choose a G AGv which satisfies (>, [1,^]) 
and (>, [£+ l,iV]) (corresponding to a standard I?-partition). Then 

a R := (T[i,e\(7[e+i,N]Oi = {a e , c^-i, . . .,a 1 , a N , . . . , a e+1 ), 

and j^Gia is the number of distinct permutations of (ai, . . . , ai), (ae+i, ■ ■ ■ , Qtjv). The following 
polynomial is an invariant of S[i t g\ x W[t+i t N]'. Let 

Ui ■= x 1 x 2 -"X i S + (a R ,[l,£\)£ + (a R ,[£ + l,N]) 

■ S + ((3, [1, £])£+(/?, P + 1, W) "' ,X%) ' 

Then j a -£ = x\x 2 ■ • ■ X£ J2 W w (a (summing over a complete set of representatives for the cosets 
w{w G Gt : w a = a}. Further, 

\\ja-A\l = (#G e a)S + (a R , [lJ])S + (a R , [i + 1, iV])||C«||J, 

where 

||C«||; = S + (a)S4a)h(a + , k + l)/h(a + } 1); 

and 

11^111 = 2 2 W +< A(6(a^)||^||;. 

This is also the squared norm (from (5.5)) of e~ L / 2 j a -£, which has the same S[i/\ x W[i + \^} 
invariance. (For an interval /, Wi is the group generated by Si and {a, : i 6 J}.) 
Further ^(1^) = (#G e a)£-(a)(Nk + l) a+ /h(a + , 1). 

Suppose that a satisfies (>, [1, £]) and (>, [£+1, N]). The following polynomial is alternating 
for x S[ i+ i tN] . Let 

a a; , = x 1 ---x E £4a R ,[l,£])£4a R ,[£ + l,N]) 



sgn(w) ( 2 2 \ 

^ £_( W a,[l,£])£_( W a,[£+l,iV]) ' ' ' ' 



«>eG f 

38 



Then a a . e = x 1 ...x l £) we£ ^ s g n ( w VC*> 

\\a a .A 2 p = £\(N- £)\£.(a R , [1, £])£-{oc R , [I + 1, N])\\C«\\ 2 P , 

and 

\\a a 4l = 2 2 ^ +i A(b(a,£))\\a a . / \\ 2 p . 

Further, 

a a -e{ x ) / ( a [i,e]( x2 ) a [m,N]{x 2 )) 
(Nk + l) a+ £^(a) 



--i N 



(Nk + l) fl h(a+,l) 



Y[{Ki(a) - Kj(a) - k : 1 < i, j < £ or £ + 1 < % < j < N}, 



where fi = (£ — l,£-2, . . . , l,0,N-£-l, . . . , 1,0) + ; recall a^^x 2 ) = Yl 1<i<j<e (x 2 -x 2 ). Again 
e~ L l 2 a a .£ is also alternating for x and its squared norm (for (5.5)) equals ||a Q; £||^. 

As mentioned above, the techniques of sections 2 and 3 can be used to describe polynomials 
with prescribed symmetry for direct products Wi x x Wj 2 • • • x Wj r x Sj r+1 ■ ■ • x Sj t for any 
collection {Ji, 1%, . . . , I t } of pairwise disjoint intervals in [1, AT]. 

More information about the generalized binomial coefficients needs to be obtained so that 
more concrete algorithms for the type-B Hermite polynomials can be found. The polynomials 
could be useful in the numerical cubature associated to the Macdonald-Mehta-Selberg integral. 
Also, such knowledge could lead to orthogonal bases for harmonic polynomials, which, by 
definition, are annihilated by YliLiiTf) 2 ; for example, these polynomials appear when one uses 
spherical polar coordinate systems to find eigenf unctions of some Hamiltonians, see Section 3.4 
in llvDI . 
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